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Abstract — In this paper we provide sufficient conditions for 
lossy transmission of functions of correlated data over a multiple 
access channel (MAC). The conditions obtained can be shown as 
generalized version of Yamamoto's result [28]. We also obtain 
efficient joint source-channel coding schemes for transmission of 
discrete and continuous alphabet sources to recover the function 
values. 

Keywords: Joint source-channel coding, Graph coloring, Lip- 
schitz functions, Correlated sources. 

I. Introduction and Survey 

Sensor networks are used in a wide variety of applications 
due to their ability to operate in environments where human 
penetration is not possible. One killer application of such 
networks is environmental monitoring. Correlated sources are 
a common scenario in densely packed sensor networks. The 
nodes in a sensor network may be arranged in a hierarchical 
fashion where neighboring nodes first transmit to a cluster 
head and then the cluster heads transmit to the fusion center, 
forming a network of multiple access channels (MACs) ([23]). 
Also the cluster heads often need to send only a function 
of the sources to the fusion center Typical functions include 
average, maximum, minimum, median or a binary function 
of the sensor readings ([12], [9]). For example sending the 
maximum of observations to the fusion center has apphcations 
in sensor networks used for fire detection in a building or oil 
spillage in sea. 

In such a set up the sensor nodes can compress the data sent 
to the cluster head exploiting the correlation in the data and 
also the structure of the function to be computed at the cluster 
head. Depending upon the function, exploiting the structure 
of the function can substantially reduce the data rate for 
transmission. Since source-channel separation may not hold in 
this case even for independent sources ([18]), one needs joint 
source-channel codes to transmit over the MAC. We provide 
joint source-channel codes that can be used for transmission 
of functions and give an interpretation of the auxihary random 
variables arising in the coding schemes for a general class of 
functions. 

In the following we survey the related literature. The semi- 
nal paper. Cover, El Gamal and Salehi [5] provided sufficient 
conditions for transmitting losslessly correlated observations 
over a MAC. They also show that unlike for independent 
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sources, the source-channel separation does not hold for this 
system. The results of [5] have been extended in [24] to the 
system with continuous alphabets, lossy transmission and side 
information. 

Korner and Marton [14] found the rate region for sending 
binary sum of two correlated uniform binary sources in a 
distributed manner They show that Ri > H{f {1/1,1/2)) 
and R2 > H{f {1/1,1/2)) is achievable where Ri and R2 
are the rates of transmission, {1/1,1/2) are the sources and 
f {1/1,1/2) — Ui S) 1/2, ® denoting exclusive-OR function. 
Their proof relies on linear codes as opposed to the more 
prevalent random codes. Yamamato [28] found the rate- 
distortion function for sending a source X to a decoder that 
has Y as side-information and must estimate f{X,Y) to a 
given distortion D. Feng, Effros, and Savari [11] extended 
this work to a system with noisy observations. 

Reference [16] uses the Korner-Marton scheme for finding 
achievable rate region for distributed source coding where the 
decoder is interested in lossy reconstruction of an arbitrary 
function. Linear codes were also used in [18] for joint source- 
channel codes that are optimal for a class of functions and 
channels. They show that for reliably constructing a function 
over a multiple access channel source-channel separation does 
not hold even when the sources are independent. Exact rate 
region is obtained when the MAC computes a linear function 
over a finite field of its inputs followed by a symmetric discrete 
memoryless channel. Achievability conditions for a general 
MAC are given using systematic codes. 

Orlitsky and Roche [19] used a graph theoretic formulation 
to find the required rate for sending X to a decoder with 
side information Y for reliable computation of f{X,Y). 
They show that the required rate for the above problem is 
Hg{X\Y) where Hg{X\Y) denotes the conditional entropy 
of the characteristic graph. The characteristic graph is defined 
by Witsenhausen [27]. An excellent survey of graph entropy 
is given in [25]. 

Vishal et al. [8] established that the minimum conditional 
entropy coloring of the OR product of the characteristic graph 
is asymptotically equal to the conditional entropy. Hence they 
provide a technique to separate out the functional coding and 
correlation coding by first coloring the graph and then applying 
Slepian-Wolf coding. It is also possible to extend this tech- 
nique to lossy transmission. The minimum entropy coloring 
from a computational view point and from an algorithmic and 



heuristics view point are given in [2] and [3]. 

Reference [9] considers the distributed encoding of func- 
tions of correlated sources and obtains a muhi-letter condition 
for the problem. It is shown that under certain conditions 
known as the 'zig-zag' condition it is possible to characterize 
the region by means of first coloring the graphs of C/i and U2 
separately and then using Slepian-Wolf codes for the colors. 

The paper makes the following contributions. We provide 
joint source-channel coding schemes for computation of gen- 
eral functions over a general MAC. The sources can be 
correlated and the source/channel alphabets can be discrete or 
continuous. The transmission can be lossy or lossless. Also 
side information may be present. For this set up we have 
developed general joint source-channel coding techniques. The 
existing literature on function transmission either studies only 
source coding or discrete sources over a discrete alphabet 
MAC. Also it mostly considers simple or specific functions. 
We show previous results as special cases of our results. The 
emphasis is on developing general techniques. 

The rest of the paper is organized as follows. Section II gives 
the sufficient conditions for lossy transmission of functions 
over a MAC. Special cases are given in Section III and 
Section IV considers joint source-channel coding using graph 
coloring. Section V gives an example to motivate joint source- 
channel codes using graph coloring. Section VI considers the 
joint source-channel coding for continuous alphabet sources 
and/or channels. Section VII concludes the paper. The proof 
of Theorem 1 is given in Appendix. 

II. Transmission of functions of sources over a 
MAC 

In this section we consider the transmission of functions 
of memoryless dependent sources, through a memoryless 
multiple access channel in the presence of side information. 
The sources and/or the channel input/output alphabets can be 
discrete or continuous. 

We consider two sources {1/1,1/2) and side information 
random variables Zi,Z2,Z with a known joint distribution 
F{ui,U2, zi, Z2, z). Side information Zi is available to en- 
coder i, i — 1,2 and the decoder has side information Z. The 
random vector sequence {{Uin,U2n, Zin, Z2n, Zn),n > 1} 
formed from the source outputs and the side information 
with distribution F is iid in time. The sources transmit their 
codewords Xin's, to a single decoder through a memoryless 
MAC. The channel output Y has distribution p{y\xi,X2) if 
xi and X2 are transmitted at that time. The decoder receives 
Yn and also has access to the side information Z„. The 
encoders at the two users do not communicate with each 
other except via the side information. The decoder uses the 
channel outputs and its side information to estimate a function 
G = f{Ui, 1/2) of sensor observations as G. It is of interest 
to find encoders and a decoder such that {Uin,U2n,n > 1} 
can be transmitted over the given MAC with E[d{G, G)] < D 
where d is a non-negative distortion measure and D is the 
given distortion constraint. We will assume that d{a, a') = 
if and only if a = a'. We also assume that either d is upper 



bounded by d„iax < 00 or there exist (u^jUj) such that 
E[d{f {1/1,1/2), f{ul,ul))] < 00. Source-channel separation 
does not hold in this case. 

Definition: The source {U", U2) can be transmitted over 
the multiple access channel to recover the function f{Ui, U2) 
with distortion D if for any e > there is an rig such that 
for all n > no there exist encoders ^ : x Z" 
A",", i = 1,2 and a decoder : 3^" x Z" ^ ^" such 



that 



< D + e where G" = 



/^(y",^") wdU,, Z„ Z, Xi, y, g are the sets in which 
Ui, Zi, Z, Xi, y, G take values. 

We denote the joint distribution of {1/1,1/2) by 
p{ui,U2)- Since the MAC is memoryless, p(j/"|a;", a;^) = 
YVj=iP{yj\^ijj^2j)- X ^ Y ^ Z will indicate that 
{X, Y, Z} form a Markov chain. 

Now we state the main theorem. 

Theorem 1: A function / of the sources {1/1,1/2} can be 
transmitted over the multiple access channel with distortion 
D if there exist random variables {Wi, W2, Xi, X2) such that 

(1) p{ui,U2, Zi, Z2, Z,Wi,W2,Xi,X2,y) = p{ui , U2, Zi , Z2, z) 

p{wi\ui, Zi)p{w2\u2, Z2)p{xi\wi)p{x2\w2)p{y\xi, X2) 

and 

(2) there exists a function fu : Wi x W2 x Z Q 
such that E[d{G,G)] < D, where G = f{Ui,U2), G = 
Id {Wi , W2 , Z) and the constraints 

I{Ui,Zi;Wi\W2,Z) < I{Xi;Y\X2,W2,Z), 
I{U2,Z2;W2\Wi,Z) < I{X2;Y\Xi,WuZ)il) 
I{Ui,U2,Zi,Z2;Wi,W2\Z) < I{Xi,X2;Y\Z) 

are satisfied where Wi are the sets in which Wi take values. 

Proof of Theorem [T] is outlined in the Appendix. In the 
proof of Theorem [1] the encoding scheme involves finding 
{Wi, W2) from the sources ([/", [/^) and the side informa- 
tion Z" , Z2 by exploiting the structure of the function and 
the distortion permitted, followed by a correlation preserving 
mapping to the channel codewords (X", X"!]-)- The correlation 
required should be such that the inequalities in ([T]i are satisfied. 
The decoding approach involves first decoding {W^ , W2) and 
then obtaining the estimate G as a function of (W", W2) and 
the decoder side information Z". 

One of the problems in applying Theorem 1 is that the 
auxiliary random variable M^'s defined are not explicit enough. 
We propose good joint source-channel coding schemes for 
obtaining W^'s in the subsequent sections. 

III. Special Cases 

In the following we show that our result contains several 
previous studies as special cases. 

A. Lossy coding of functions with side information 

Choose Y = {Xi,X2) in O and also Xi ^Wi, i = 1,2. 
Then the R.H.S of Q evaluate to H{Wi\W2), H{W2\Wi) and 



H{Wi, W2) respectively. Thus we get a rate region 

Ri > IiUi,Zi-Wi\W2,Z), 
R2 > I{U2,Z2;W2\WuZ) (2) 
R1+R2 > I{UuU2,Zi,Z2;Wi,W2\Z). 

If we take (Zi, Z2)-L(C/i, C/2, Z) and U2 = W2 = 
constant, then i?i > I{Ui;Wi\Z) and we have a decoder 
such that from Wi and Z it can estimate f{Ui,Z) within 
distortion D. This recovers the resuh in [28]. 

B. Lossy coding of functions with side information and remote 
sources 

The resuhs of [11] can be recovered by applying the theo- 
rem to Ui and Z where Ui and Z are noisy versions of Ui and 
Z. Similar to the above example we need Ri > I{Ui \ Wi\Z). 
We choose the distortion measure to allow dependence of 
the distortion measure on Z. So from the theorem we 
need E[d{Ui,Z,g[W,Z))] < D where d{Ui, Z , g{W, Z) = 
T^imxz) G Uixz Pi^T-' ^W{ui, z), g{wi, z), z). 

C. Distributed joint source-channel coding over a multiple 
access channel 

If we take f{Ui,U2) — {Ui,U2), then we recover the results 
in [24] for joint source-channel coding of correlated sources 
over a multiple access channel with side information. 

IV. Joint-source channel coding for discrete 

SOURCES AND CHANNELS 

In this Section we extend the graph coloring technique given 
in [9] to joint source-channel coding of functions of discrete 
sources. The channel alphabets can be discrete or continuous 
(in particular the channel can be a GMAC). We explain the 
graph related terminologies through relevant previous work. 

Consider sources {Ui,U2) E {Ui,U2)- The following def- 
initions are from [25]. The characteristic graph G — {V,E) 
of Ui w.r.t. U2 and / has vertex set V — Ui and the edge 
set E consisting of edges (^11,1*12) € if there exists a 
U2 e U2 such that U2)p(wi2, U2) > and /(un, ^2) 7^ 

/(ui2,M2). Hence G represents the confusability graph from 
the decoder's perspective. The conditional graph entropy is 
defined as 

HGmU2) = minu,<,w<,nG)I{W; t/ilC/2), 

where W ^ Ui ^ U2 and r(G) denotes the set of stable sets 
of G.Q 

The vertex coloring of a graph G — {V, E) is any function 
c:V^N where M is the set of natural numbers, such that 
(uii,iti2) € E implies c(uii) 7^ c(ui2). The entropy of the 
coloring is the entropy induced by the distribution of {Ui,U2) 
on the colors and is called chromatic entropy. 

The OR-product graph ([1]) of G is denoted by G" = 
(Vbfl, Eqr) where Vqr = V" and two vertices (un, U12) G 
Eqr if any of its components (Miii,ui2i) G E. 

' A stable set is a set of vertices where no two of its elements are adjacent. 



The conditional chromatic entropy Hq[Ui) — 
mine -colorings c i? (c([/i ) | C/2 ) is defined in [8] and it 
is proved that lim„^oo ii/^-CUilUa) -> Hg{Ui\U2). This 
result is an extension of Korner's result in [13] and implies 
that for large n we can color most of the OR-product graph 
G" (the component of the graph G" left uncolored has low 
probability) and send the colors to achieve an optimal coding 
scheme. Thus the graph coloring scheme can decouple the 
functional coding from the correlation coding. 

In [9] the achievability results are shown for the distributed 
functional source coding problem provided the joint distri- 
bution satisfies a zigzag condition, i.e., p{xi,yi) > and 
P{x2,y2) > imply either p{xi,y2) > or p{x2,yi) > 0. 
The achievable rate region is obtained by first coloring the 
OR-product graph and then compressing the colors through a 
Slepian-Wolf coding scheme. 

Our coding scheme also relies upon coloring the graph and 
thus separating functional source coding and the correlation 
coding. We assume that the zigzag condition holds. If we allow 
distortion in evaluating the function we can color a subgraph 
of the original graph [7] using a choice of colors that achieve 
the minimum chromatic entropy. Once we color the graphs at 
both encoders, the correlated colors are sent to the decoder 
using good joint source-channel coding schemes. The joint 
source-channel codes preserve the correlation in the colors 
and thus help in combating channel noise. The effectiveness 
of joint source-channel codes is shown in [21] and [24]. Using 
joint source-channel coding schemes the colors are losslessly 
recovered at the decoder and the zigzag condition ensures that 
the function can be recovered within a given distortion D. We 
demonstrate the performance of this joint source-channel code 
for functions through an example where we show that this joint 
source-channel coding scheme outperforms the scheme with 
Slepian-Wolf coding on colored outputs. 

V. Example 

Let {Ui, U2) take values in the set {1, 2, 3} and be jointly 
distributed with M2) = 1/6 for all ui ^ U2 - The function 
to be computed at the receiver is f{ui,U2) — 1 if ui > U2 
and otherwise. The zig-zag condition holds for this case. Let 
the sources be transmitted over a multiple access channel with 
input alphabets {0,1} and the output alphabet {0,1,2}. The 
MAC output Y = Xi + X2- The sum capacity of this channel 
is 1.5 bits. 

If we consider transmitting the sources losslessy without 
exploiting the correlation and the structure of the function we 
need log{3) = 1.58 bits at each encoder Hence the sum rate is 
3.16 bits and {Ui, U2) cannot be transmitted over the channel. 

Next we exploit the correlation between the sources and 
not the structure of the function, i.e., we recover the sources 
at the decoder and then reconstruct the function. We com- 
press the sources using Slepian-Wolf codes with sum rate of 
H{Ui, U2) = 2.58 hits. Still we will not be able to transmit 
over the channel with independent code words. 

The characteristic graph defined on the set {1,2,3} at 
encoder 1 with respect to / and U2 will have a single edge 



between 1 and 3. Similarly for encoder 2. Now we consider 
coloring of the graph. Let Ci(l) ^ Ci(2) ^ and Ci(3) ^ 1 
at encoder 1. Similarly define C2 for the second encoder. 
The coloring takes into account the structure of the function. 
If we don't exploit the correlation we can send the colors 
at 0.918 bits at each encoder This requires a sum rate of 
1.8366. One sees that exploiting the structure of the function 
substantially reduces the data rate. However the channel still 
does not support the transmission. 

Next we do Slepian-Wolf coding on the colors and then 
use independent channel code words. The joint entropy of the 
colors i/(Ci, C2) = 1.58 hits and the channel capacity is 1.5 
bits. Hence even in this case the function can not be evaluated 
losslessly. 

Next we consider a joint source-channel code where the 
colors are mapped to channel alphabets — C\ and X2 = 
1 — C2. This produces correlated channel codewords and it 
meets the condition for joint source-channel coding since 
i7(Ci, C2) = /(Xi, X2; r) = 1.58 bits and hence the colors 
can be recovered lossessly at the decoder. Given the colors 
the function can be evaluated. Thus we notice that we can 
exploit the correlation between the sources, the structure of 
the function and the structure of the channel to construct joint 
source-channel coding schemes via graph coloring. 

Finally we show the use of side information. The decoder is 
provided with Z — \Ui — U2\- The colors are compressed via 
Slepian-Wolf taking into consideration the side information Z 
also. Hence the sum rate required is reduced to 1.32 bits and 
we can transmit the sources losslessy via independent channel 
codes. 

VI. Joint source channel coding for continuous 

SOURCES and channels 

In this section we consider joint source-channel coding for 
continuous alphabet sources. 

Let / be Lipschitz: there is an a > such that U2) — 

f{u[,U2)\ < ad{{ui,U2),(u'i,u'2)) for all (ui,-U2), (wi,W2)- 
Then£;[|/(?7i,C/2)-/(C/i,;72)|] < a^K(C/i, C/2), (i/i, C/2))] 
where {Ui,U2) is an estimate of {1/1,1/2) at the decoder. 
Thus for distortion within D in function estimation, if 
E[d{{Ui,U2)AUi,U2))] < S where S = D/a, our require- 
ments on function estimation are satisfied. This motivates us 
to obtain the following schemes. Of course these schemes can 
be used in conjunction with other properties of / (instead of 
Lipschitz as mentioned above). 

A. Coding ofUi, i — 1,2 

Scheme 1: Obtain via vector quantization of 

iUl\U^) (with distortion < d). Transmit {W^,W^) loss- 
lessly via a joint source-channel coding scheme. Approximate 
f{Ui,U2) at the decoder via /(Vl^i, ^2)- This scheme exploits 
only the Lipschitz property of the function. 

Scheme 2: Obtain (M^", W2 ) via vector quantization as in 
scheme 1. Apply graph coloring to (W", W^f) as in Section 
IIVI These colors are further compressed via Slepian-Wolf 
coding. The compressed colors are sent over the MAC using 



independent channel code words. This scheme corresponds to 
the separation based (SB) scheme ([18]) for function coding. 

Scheme 3: Obtain (W^", Wj') ™d apply graph coloring as 
in scheme 2. The colors are sent over the MAC using a joint 
source-channel code and the functions are estimated from the 
colors. 

We compare the performance of the three schemes via 
examples. In all our examples below we see that scheme 3 
performs the best although sometimes scheme 1 and scheme 
3 provide the same outcome. In the following we not only 
consider Lipschitz functions but also others to illustrate that 
these ideas have general applicability. 

B. Difference of Gaussian sources over a Gaussian MAC 

We consider correlated Gaussian sources {1/1,1/2) with 
mean zero, variance and positive correlation p and are 
interested in estimating Ui — U2 at the decoder Each of the 
channel inputs is power constrained to P and the sources are 
sent over a GMAC with receiver noise variance = 1. This 
function has been considered in [15] and [26]. 

We compare the performance of the above schemes along 
with a few other schemes natural for this setting. Some of these 
schemes have been already studied in literature. Of course 
as against these schemes the three schemes proposed above 
are applicable to general classes of functions, sources and 
channels. 

To put the performance of different coding schemes in a 
proper perspective, we also consider a lower bound on achiev- 
able distortion by considering a centralized encoder which has 
both the sources. The channel input X — a{Ui ~ U2) is 
power constrained to 2P. Hence it is equivalent to a point to 
point channel given hy Y ^ X + V where V is independent 
Gaussian noise with zero mean and variance 1. The lower 
bound obtained via this system on the mean square distortion 
(MSB) of the function is given by 



2cT^(l-p) 
1 + 2P ' 



(3) 



We also study a scheme where Xi = VpUi and X2 ~ 
— \/PU2- In this scheme the channel codewords are scaled 
versions of the source. Thus we call it Amplify and Forward 
(AF). At the decoder the difference of the sources are esti- 
mated from the channel output as E[{Ui ~ U2)\Y]. Then the 
MSB is 

2a'il-p) 



Daf = 



(4) 



1 + 2P(1 - p) 

From (O and (|4|i we see that Daf approaches Dcen at low 
p. A similar conclusion holds if / is any additively separable 
function. 

Lattice coding schemes in [10] have been shown to improve 
upon the AF, discussed above for this system. In addition to 
considering these schemes we also compare performance with 
the lattice coding scheme given in [26]. 

Next we consider Scheme 2. For the specific case of differ- 
ence of Gaussian sources over a GMAC, the characteristic 
graph formed from (Wi,W2) and / is complete. Hence 



Hg{X) = H{X) and coloring the graph does not give any 
advantage. The colors compressed via Slepian-Wolf are sent 
over the MAC using independent channel code words. 

Next consider Scheme 1. In the example the colors are 
mapped to Gaussian codewords, using the correlation pre- 
serving mapping provided in [17]. This scheme is shown to 
perform well in [22]. At the decoder the function is estimated 
from the colors. Because the graph is complete Scheme 3 is 
same as Scheme 1. 

We compare the schemes discussed above in Figs. [T] and 
|2]for p — 0.5 and 0.75. Since Lattice codes need P > 0.5 
for error free decoding, we compare the schemes only in this 
region. From the figures we see that Scheme 1 performs better 
than scheme 2 for all SNR and p. Also for lower p, AF is 
closer to the lower bound than the lattice coding scheme. In 
this example, since the function was matched to the GMAC, 
AF and lattice codes provide considerable gains. Next we show 
by an example that this is not always true. 
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Fig. 2. Comparison of schemes for joint source-channel coding of functions, 
p = 0.75 
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Fig. 1. Comparison of schemes for joint source-channel coding of functions, 
p = 0.5 

C. Binary function of Gaussian sources over a Gaussian MAC 

Consider the sources and the channel to be the same as in 
the above example. The function to be computed is 

f{min{Ui, U2) > 0) = 1, f{min{Ui, U2) < 0) = 0. 

The natural W^s for this case are as follows. The Wi at 
encoder i is = 1, if [/, > else Wi = 0. The {Wi, W2) thus 
obtained are jointly distributed with zero mean and covariance 




where p is the correlation between {Ui^U2)- 

We color the W^s at each encoder. Since the characteristic 
graph is complete, coloring does not give any advantage. For 
p = 0.75 and P 5, by Slepian- Wolf coding {Wi, W2) can 
be compressed to H{Wi,W2) — 1.778 bits (this scheme is 
similar to scheme 2). However the channel capacity is only 



1.729 bits and {Wi, W2) cannot be reliably transmitted. Thus 
the function cannot be losslessly computed. 

Next we send {Wi, W2) using a joint-source channel coding 
scheme (similar to scheme 1 and 3). Such bit to Gaussian map- 
ping schemes are discussed in [21]. The correlation between 
(1^1,14^2) is 0.54 and we consider mappings of (Wi,W2) 
to jointly Gaussian codewords with correlation 0.3. Then 
the channel supports sum rates till 1.903 bits and hence the 
function can be losslessly computed. 

If we consider AF or the lattice coding scheme, the sources 
cannot be recovered losslessly at the decoder (since P is finite) 
and hence the function also cannot be losslessly computed with 
these schemes. 

D. Uniform continuous sources over a discrete MAC 

So far we have seen that graph coloring does not help for 
continuous sources. But the next example shows that it can 
indeed still be useful. {Ui, U2) take values in [0, 1] x [0, 1]. 
The joint density is in [0 1/3] x [0 1/3], [1/3 2/3] x 
[1/3 2/3] and [2/3 1] x [2/3 1]. In the rest of the regions 
the joint density is uniform. The sources are to be transmitted 
through the MAC (Y = Xi + X2), given in the example in 
Section [V] with a specified distortion. The distortion measure 
d{x, x') = [a; — x'l. The decoder is interested in finding \Ui — 
U2\ within a distortion of 16.67%. 

We quantize {Ui,U2) via a uniform grid on [0 1] x [0 1] 
dividing each axis into three parts. Hence there are 9 represen- 
tation points. These representation points are at the center of 
each square cell. Thus each Wi, i — 1,2 takes 3 values. Graph 
coloring is applied to W-s. The characteristic graph of Wi has 
three vertices {1, 2, 3} and there is an edge between 1 — 2 and 
2 — 3. Hence we can color this using two colors. If we use 
Slepian-Wolf coding on the colors, they can be compressed to 
1.58 bits whereas the channel capacity is only 1.5 bits. Hence 
scheme 2 will not be able to support this transmission and 
the distortion constraint is not met. But these colors can be 



jointly transmitted across the channel by using the joint source- 
channel coding scheme: Xi = Ci, X2 = I — C2. Thus we 
can transmit with a distortion of 16.67 % via scheme 3. 

If we try to send (^1,^2) without coloring (i.e., not 
exploiting the structure of the function) using a joint source 
channel code, H{Wi, W2) = 2.58 bits. The channel capacity 
is only 1.5 bits. Thus we cannot transmit {Wi, W2) losslessly 
via scheme 1 and again distortion constraint is not met. 

If we use vector quantizers instead of scalar quantizers as in 
this example the distortion is further reduced in the coloring 
scheme. 

VII. Conclusions and Discussion 

In this paper we provide sufficient conditions for lossy 
transmission of functions over a MAC. Efficient joint source- 
channel coding schemes are developed for transmission of 
discrete and continuous alphabet sources. It is shown that 
by exploiting the function structure substantial savings in 
transmission rate can be obtained. Although, a good coding 
scheme can depend upon the function, the source statistics 
and the channel, we identify schemes which perform well for 
various classes of functions, sources and channels. 

The results in this paper are information-theoretic and hence 
address the fundamental limitations of the communication 
system. From our results one can determine if one can transmit 
data on a MAC so that it will be possible for the receiver to 
compute the value of the function within a given distortion. 
However, one needs to develop practical coding schemes to 
design such a system and the aim of the designer is to develop 
codes that perform close to the information theoretic limits 
provided. Also, our results, as often happen in information 
theory, can provide significant insights in designing practical 
codes. For example, now practically implementable codes 
for Slepian-Wolf coding are available ([20], [4]). Thus our 
Scheme 2 can be implemented in practice. Recently there is 
also some work on practical implementation of joint source- 
channel coding ([29]). 

Appendix 

We show the achievability of all points in the rate region 
(1). The proof is an extension of the proof in [24]. Thus we 

will outline the proof. Initially we prove it for bounded d 
and discrete {U\, U2, Zi, Z2, Z). At the end we will generalize 
these assumptions. 

Proof: Fix p{wi\ui, Zi),p{w2\u2: Z2),p{xi\wi),p{x2\w2) 
as well as /d(-) satisfying the distortion constraints of the 
form E[d{f{Ui,U2),giWi,W2,Z))] < D, where 5 is a 
deterministic function. 

Codebook Generation: Let = I(Ui, Zi;Wi) + 6,i € 

{1,2} for some ^ > 0. Generate 2"^* codewords of length 
n, sampled iid from the marginal distribution p{wi),i E 
{1,2}. For each w" independently generate sequence X" 
according to nj=iP(2;y|^ii))* ^ {1, 2}. Call these sequences 
Xi{wf),i e 1, 2. Reveal the codebooks to the encoders and the 
decoder. 



Encoding: For i e {1,2}, given the source sequence C/f 
and Z", the i*'' encoder looks for a codeword W" such that 
(C/f , , W7) G T^{Ui,Zi, Wi) and then transmits Xi(Wf ) 
where T"(.) is the set of e-weakly typical sequences ([6]) of 
length n. 

Decoding: Upon receiving F", the decoder 
finds the unique {Wi,W2) pair such that 
W^,xi{W{'),X2iW^),Y",Z") e Tf. If it fails 
to find such a unique pair, the decoder declares an error and 
incurres a maximum distortion of dmax ■ 

In the following we show that the probability of error for 
the encoding decoding scheme tends to zero as n ^ 00. The 
error can occur because of the following four events E1-E4. 
We show that P(Ei) 0, for i = l,2, 3, 4. 

El The encoders do not find the codewords. However from 
rate distortion theory [6], page 356, lim„^oo = if 
R- > I{U„Z,;W,),i€ 1,2. 

E2 The codewords are not jointly typical with Z". Prob- 
ability of this event goes to zero from the extended Markov 
Lemma. 

E3 There exists another codeword such that 

{w^,W^,xi{w^),X2iW^), Y"',Z'') e Tf. Define a= 
[wi, W2", xi lwY), X2{W^), y", Z"). Then, 

P(E3) = Pr{There is ^ < : a e } 

< Pr{aeT^} (6) 

It can be shown that P(E3) tends to zero if 
I{Ui,Zr,Wi\W2,Z) < I{Xi-Y\X2,W2,Z). Similarly 
I{U2, Z2; W2\WuZ) < I{X2; Y\Xi,Wi,Z). 

E4 There exist other codewords and W2 such that 

a^(w5|',wJ,.Ti(i&5|'),a;2(w^'),y",z") e Tf. Then, 

P(E4) = Pr{There is (wj*, w^) ^ (wj*, w^) : a e T^} 

It can be shown that P(E4) tends to zero if 

I{Ui,U2,Zi,Z2:Wi,W2\Z) < I{X,,X2:Y\Z). 

Thus as n ^ 00, with probability tending to 1, the decoder 
finds the correct sequence (W", W2) which is jointly weakly 
e-typical with ([/f , U^, Z"). 

The fact that (W", W2) are weakly e-typical with 
(C/f, C/2", 2'") does not guarantee that fJi,{W^,W:^,Z'') 
will satisfy the distortion D. For this, one needs that 
{Wi, W2) are distortion weakly e- typical (in the sense 
that < D is also satisfied 

by the weakly e-typical set) ([6]) with {U]^\U^\ Z""). Let 
^ denote the set of distortion typical sequences ([6]). 
Then by strong law of large numbers P(T5 Jt,") ^ 1 as 
n ^ 00. Thus the distortion constraints are also satisfied 
by obtained above with a probabiUty tending to 

1 as n — > 00. Therefore, if distortion measure d is bounded 
\xm^^^E[d{f{U^,U^)),fD{W^,W^,Z^)] < D + ei = 
1,2. 



If there exist u*, such that 

E[dif{U^,U^))Jiul'\u*''')] < oo, then the result extends 
to unbounded distortion measures also as follows. Whenever 
the decoded (VF", are not in the distortion typical 

set then we estimate f{U]^,U^) as /(ut",U2")- Then for 
i = 1, 2, for large enough n, 

E[d(f{Ul\ U^), foiW^^, W^, Z"))] < A + e 

+i?K/([/r, U^), /K", "r))l(Ts,,)e] (8) 

Since E[d{f{Ul\U^'))J{ul'',u^"')] < oo and 
P[iT'D,cT] ^ as n ^ oo, the last term of ® goes 
to zero as n — * oo. 
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